Sparse linear mixed model selection via streamlined variational Bayes

نویسندگان

چکیده

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random from multiple sources of variability. In many situations, large number candidate is available it interest select parsimonious subset those being effectively relevant predicting the response variable. Variational approximations facilitate fast approximate Bayesian inference parameters variety models, including linear models. However, having high or effects, simple application standard variational principles does not lead algorithms, due size model design matrices inefficient treatment sparse matrix problems arising required approximating density updates. We illustrate how recently developed streamlined procedures can be generalized make accurate with nested global-local priors selection. Our algorithms achieve convergence same optima their implementations, although significantly lower computational effort, memory usage time, especially numbers effects. Using simulated real examples, we assess quality automated selection that free hyperparameters tuning only rely upon posterior approximations. Moreover, show accuracy against fitting via Markov Chain Monte Carlo sampling.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Variational Bayes via Propositionalization

In this paper, we propose a unified approach to VB (variational Bayes) [1] in symbolicstatistical modeling via propositionalization1. By propositionalization we mean, broadly, expressing and computing probabilistic models such as BNs (Bayesian networks) [2] and PCFGs (probabilistic context free grammars) [3] in terms of propositional logic that considers propositional variables as binary random...

متن کامل

Functional regression via variational Bayes.

We introduce variational Bayes methods for fast approximate inference in functional regression analysis. Both the standard cross-sectional and the increasingly common longitudinal settings are treated. The methodology allows Bayesian functional regression analyses to be conducted without the computational overhead of Monte Carlo methods. Confidence intervals of the model parameters are obtained...

متن کامل

Hierarchical Model Selection for NGnet Based on Variational Bayes Inference

This article presents a variational Bayes inference for normalized Gaussian network, which is a kind of mixture models of local experts. In order to search for the optimal model structure, we develop a hierarchical model selection method. The performance of our method is evaluated by using function approximation and nonlinear dynamical system identification problems. Our method achieved better ...

متن کامل

Online Model Selection Based on the Variational Bayes

The Bayesian framework provides a principled way of model selection. This framework estimates a probability distribution over an ensemble of models, and the prediction is done by averaging over the ensemble of models. Accordingly, the uncertainty of the models is taken into account, and complex models with more degrees of freedom are penalized. However, integration over model parameters is ofte...

متن کامل

Model Selection , Covariance Selection and Bayes Classification via Shrinkage Estimators

Statistics) MODEL SELECTION, COVARIANCE SELECTION AND BAYES CLASSIFICATION VIA SHRINKAGE ESTIMATORS by

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronic Journal of Statistics

سال: 2022

ISSN: ['1935-7524']

DOI: https://doi.org/10.1214/22-ejs2063